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Sir: 




AFFIDAVIT UNDER 37 C,F-R- §1.131 

I, Chin-Hui Lee, hereby state: 

1 . I am an inventor of the claimed subject matter in the Patent Application identified above 
and an inventor of the subject matter described therein.. 

2. Prior to Apnl 16, 1 999, my co-inventor and I participated in the conception of spotting 
key segments in voice messages, as covered by the above-identified Patent Apphcation, as 
evidenced by the following: 

We submitted notations for a patent application disclosing my conception of the 
invention prior to April 16, 1999, and after the date of conception. These notations are reflected 
in an invention submission form, which is kept in the regular course of business. A true and 



correct copy of this invention submission form is attached hereto as Exhibit ^Thereafter, we 
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. necessary for subsequent filing of the above referenced 

PMomApplicanonm the Umtcd states, wm -— " T\ 

cf.t.>c Parent Office on June 3, 1999, as eviacn / ^ i ^ 

states PaMiuutl" fonn was sent to outsid. council on June 16. 

.„.e.™ple,.he — — fj- 
,.,.o.ep^ap..en.epp,lcat.on.ev.e.e^.V^^^^^^^ 

patent appl-cation and provide cements and changes the ^ 
.as completed. Evidence of the draft applications that ^ _^ ^ 

„,p.andF. Theft.tdta<twassentton,,co.inventotonOctoh«,5.U9B. o 

„,.,.edh.B.hihitC.Addltiona.lv>eseconddta«wass.n.Koven.he.^^ 

^ ' . T7«Kn,arv 10 1999. as evidenced by bxmo.. 
J c >,ii,ii= n the third draft was sent February lu, f-". " 
evidenced by E.htb,tsD, the thtrd ,^.,E.d»bitF After the final draft was 

a.,d,heftnaldraftwassentMayl2.imasev,den=edbyErf»b,.F. 

.„™p-,eted and ready ror film. »e srgned the Deception and Assi.,n,ent ror™« as ..c,e,..ec 

""Hle^her,ha.a,Utate„e„.sn^ehere.no.,nyow„.t,.w-^^ 
a„staten.e„.s.adeo„i„fotma.,onandbe,ierarebe,ievedtobetmeandftt«h=rtha.thcse 

s..en,entswerentadew..hthe.owledse.h3.wi,lft.U..sestaten,entsandthe,.e.™^^^^^^ 
,„„ishab,ebyr.neor,n,prlso.unen..orboth.„nde.Sec«onlOO,ofTiOelSof.heUntedStates 

L..d,ha,snchwil,rulfalses,ate.e„tsn.y.eop»aiz.thevahdityor.heAppl.c..,ono.any 

patent issuing thereon. O^C^\ i^^ ^lC ^ - ^ ^ 

Chin-Hui Lee 



Date: 
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^ ' « data; February 26, 19W 

suftfect Patent Proposal 

from: SidlLAhuja 
Org« BL011330 

908-582-442$ 




tL D. Slusky: 



Please comider, for patentable features, Chin^Hui Lee and Padma R^esh;s '^ojj 
MeS^e Hlterik^ forchssification of Voice Messages According to the CaUer^. This matenal has 
already been discussed informally with Ken Brown. 



MH'BL011333-lc 




Copy to 
Ken Brown 
Chin-Mui Lee 
Padma Ramesh 
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For Dcfpt Head/ Dtrector'j Use Only 



For rp-Uw Use Only 



LUCENT TECHNOLOGIES, INC. 

DISCLOSURE OF INVEhJTION 

THIS DESCRIPTION SHOULD BE SUPPLEMENTED BY ATTACHING COPIES OF RELEVANT DOCUMENTS* SUCH AS 
TECHNICAL MEMORANDA, PUBLISHED OR TO-BE-PUBLISHED ARTICLES, AND ENGINEERING NOTEBOOK PAGES, 
(Also, if for aay item there is insuSldeat space on the fbmu attach addi tion al pages as Gcccssary.) 

DESCRIPTIVE TTTLE OF THE INVENTION: K^^ f^^ ^tfv^b Sj^th^ Vo.ce 

MfftS*^^^ • 



INVENTOR #1: 



Name (Print) 



U(>g /mh 



Company/Location 
Phone/E-maii t^;*-^«^»« xr«™* 



INfVENT0R#2: T^^^^ T^a.^esk 

Name (Print) 



Dircctor*s Name 



H^^^Q vwovr^A ' bell- U^- Covwt 

Phonc/E5n5i Director's Name 



Comp^y/Lpc^on 



INVENTOR #3: 



Name (Prim) 



Company/Locatioii 



Phone/E-maii 



Director's Name 



Z PRIMARY CQNTACT ^ , r ■ u 

If more than one inventor is named above, who will have the primary responsibilities for mterfacmg with 
Lucent IP*Law with it$pect to preparing and prosecuting a patent application for the invention? 



Inventor Name: ^ocd^ 



3. PRFSFNT STATE OP THE INVENTION 
[~{ Idea Research ^ Development 
rn Manufecture (Product Name »^ 



Ship Date , 



4, GOVERNMENT CQNTRA CJ fNVENTTON 

Was the invention made under a government contact? [_| Yes No 



1/2 
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C?ass number 3£ . 
Criterion letten ^^e^ 



Si 



for Dept Head / Director's Use Only 



For IP-Law Use Only 



LUCENT TECHNOLOGIES, INC. 

nTSrT OSTIRE OF INVENTION 

THIS DESCRIPTION SHOULD BE SUPPLEMENTED BY ATTACHING COPIES OF RELEVANT DOCUMENTS, SUCH AS 
TECHNICAL MEMORANDA, PUBLISHED ORTO-BE-PUBUSHED ARTICLES, AND ENGINEERING NOTEBOOK PAGES. 
(Also, if for any hem there is insufficient space on the fonn, titach additional pages as necessaiy.) 

DESCRIPTIVE TITLE OF THE INVENTION: K"^ Q^^^^^vt^r S^^tti^^ -.^ Voice 

^'"^•^ay-S 



INVENTOR. #1: r.W.v> - Hl^L 

Naiue (Flint) 



U4>s /kaW 



Conqjany/Locadoa 



Phone/E-mail Director's Name 



INVENTOR #2: Tk^v^o^ "Ra.v»vesU 

Name (Print) 



^ Phonie/E-mail 



Cffl 



ion 



Director's Name 



INVENTORY: 



Name (Print) 



Phone/E-iBMl 



Company/Location 



Director's Name 



2. PRIMARY CONTACT . r • ^ - -.u 

If mote than one inventor is named above, who will have the prunaiy responsibilities for mterfacmg with 
Lucent IP-Law with respect to preparing and prosecuting a patent application for the invention? 

Inventor Name: VoLdvv>o. 'Rft^Ae&U 



3. PRESENT STA JF. OF THE INVENTION 
□ Idea Research ^ Development 
[~] Manufacture (Product Name 



Ship Date , 



4. nOVERNMENT CONTRArT INVENTION 

Was the invention made under a government contact? {_] Yes No 



1/2 
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SUBMISSION INFORMATION 



Attorney:. 



Filing D«adline:__ , 

Date Received fxatsi mA01^ 3 , 

PLEASE SUPPLY WHATEVER INFORMATION IS READILY AT HANDt 
(Xt addittonal space i* needed, please use a second sheet) 



INVENTOR:. 



SSN (if known);. 



Last 



Fint 



Organizadoh Mft-i ^^-^ //33 



Middle 



Last 



First 



SSN (if known):. 



Organization isi*^-^ f/- Q // 3 



Middle 



INVENTOR:. 



Last 



SSN(if knowiO:_ 
Organization Nqj_ 



First 



Middle 



INVEMEOBBiln, 



Laa« 



SSN («known)t_ 

Organization Noj 



Hnt 



Middle 



Please attach all paperwork desired to he hound into folder. 



FT 3«0jabiiifo (10/97) 



I 
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Voice Message Filtering for Classification of Voice Messages 

according to the Caller 
. ... Padma Ramesh and Chin-Hui Lee 

This is an application of Speaker Verification Speaker ID for identifying the 
callers and dasaifying the messages in Voice m^l. 

For example, To get messages from the caller "Tom": Use speaker verification 
and/or identification to Detect the messages from "Tom" . 

This appUcation also uses the cmrrent knowledge in speech recognition, 
wordspottins, utterance verification, and extends it to the voice message filtering 
appHcatiou to classify and retrieve messages from the caUers. It will also use 
speech coding technology for use with coded voice mail messages. There is no 
known product at this time for this application. 

The purpose of this appUcation is to identify the caller and classify the voice 
messages according to the caller. The call classes can be assigned priorities based 
on the caller. This enables priority messaging, which is important when sortmg 
through a lot of voice maU messages. This speeds up the process of looking for 
messages from certain people. This invention wiU verify if the message is from a 
registered or a given caller and then classify the messages according to the caller. 
It can then retrieve only the desired messages. This wiU enable one to just get to 
the desired message mstead of having to listen to aU the messages sequentially up 
to the one, the user is interested in. 

Caller classification and message filtering is achieved by the foUowing steps. 
I 1. First the users register the callers they would like to spot in the messages. 

; Diiring the registration, the caUer characteristics are stored. Then the user 

■ can provide a call priority for the caller class. 

I 2. When a message is received, its caller class is determined by performing 

i speaker verification and/or identification using the caller characteristics, 

j Messages are then sorted using the caller classes. 

3 When the user requests messages from the caller class, the messages from 
that caller class are retrieved from the sorted messages. The user can also 
i request messages with a given call priority. Messages from all the call classes 

j with the given priority are then retrieved. 

i User Registration: , . . 

; The following steps are used in the user registration process and is shown m t igs. 
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la and lb. 

1. User listens to a message firom the caller. 

2. The user registers it as a caller class by pressing **S (for save). 

3. The caller's characteristics are then saved and stored as a code book or an 
acoustic segment model with HMM. 

4. The system prompts the user to provide a caller class ID. 

5. A caller class ID is given to the system as a speech sample from the user, or 
as text from a keyboajrd if available, or as a number on the keypad such as 
#5. Each class can have speech, text, or number ID or any combination of 
these. 

8. The caller class ID is then registered by pressing **R. 

7. If speech sample is given for the caller class ID, its pronunciation is 
obtained by speaker independent speech recognition, and is stored. For the 
caller class ID of text, a text-to-speech front end is used to determine the 
pronunciation. The pronunciation is edso stored in addition to the text. This 
can be used later on for message retrieval with speech input. 

8. If desired, a call priority can be assigned to the call class by pressing #3**1 
for a priority of 3. Message classes that are not given any priority by the 
user are assigned a default priority. 

9. The user terminates the registration of this caller by pressing ##. 

Message Handling! , - 

Message HandHng is shown in Fig. 2a. Every message that is received is 
compared to the registered caller's voice characteristics. Speaker ID is performed 
using all the registered voice patterns, or speaker verification can be performed 
sequentiaUy to identify the caUer of the message. The message is then tagged with 
the caller class ID, as belonging to that caUer class. The messages are then 
classified by the caller classes. Messages that do not belong to any caller cla^s are 
identified and grouped as belonging to the "other class". 

Message Retrieval: 

The message retrieval phase is shown in Fig. 3. 
1 The user requests messages from a particular caller class by either speaking 
or typing the caller class ID, or by pressing the keypad number, for 
example, #5**M for messages from the caller class 5. 
2. If the caller class ID is given as speech, speech recognition is performed on 
all the registered class ID's with pronunciation, to determine the requested 
class ID. 
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3. Messages from the requested cailer class are played back to the user 
sequentially. 

4 If messages with a particular priority are requested by pressing #3**C for 
calls with priority of 3, aU the messages from call classes with the priority of 
3 are played back sequentially. 
In addition to caUer classification and message retrieval, a Ust of all the registered 
callers is provided by **L key. In order to provide a secure access to the messages, 
speaker verification caa be used to verify that the user is an authorized user. 

If a caller's voice pattern is not registered, but only their name is registered, the 
name segment can be detected and verified using Key segment detection and 
utterance verification using the pronunciation. For example, to get messag^ from 
the caUer "Tbm\ detect and verify the phrase "My name is Tom" or 'This is 
Tom" in the message. This is done by using key segment detection and utterance 
verification, with the speaker independent subword Hidden Markov Models 
(HMM) and the pronunciation to look for caller name phrases such as "This is 
Tom", "Tom here", "My name is Tom" and so on- Message Handling when the 
caller's vtrice is not registered is shown in Fig. 2b. 

Caller classification can also be achieved by re^tering the phone number for the 
caller, and extracting the extracting the telephone number using Caller ID (if 
available). 
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Key Segment Spotting in Voice Messages 
Padma Ramesh and Chin-Hui Lee 

This is an appUcafeion of key phrase detection and verification for key segment 
spotting in voice mail. 

For example, To spot name segments: Detect and verify the segment "My n^ne is 
" or "This is .". To spot the phone number segment, detect and venfy the 

^gment "My number is ..." or "Call me back at " or even spotting the digit 

part of the message such as "my number is 364-7589". 

This appUcation uses the current knowledge in speech recognition, wordspotting, 
utterance verification, and speech coding, and extends it to the key segment 
spotting appUcation for voice mail messages. There is no known product at this 
time for this application. 

The purpose of this appUcation is to identify and spot segments containing key 
information in voice messages. This is important when sorting through a lot of 
voice mail messages. This speeds up the process of looking for particular 
messages, messages from certain people, or when looking for certam segments of 
the messages. This invention will spot the key segments and can then retrieve 
only the desired segments. This will enable one to just get to the desired section 
of the message instead of having to Usten to the message up to the desired 
segment. 

Keyword Segment Spotting is achieved as follows. First the users register the key 
segments they would Uke to spot in the messages. This can be done via text, or 
by voice. General key segments such as name segments and phone numbers may 
be provided without re^stration as predefined segments. To access these the user 
may use certain keys on the phone, such as, **T for the telephone number 
segment, **N for the name segment, **D for the date segment, and so on. 
Furthermore, the telephone number detection with **T aUows for phone number 
verification, as weU as for redial with **C. Also, the user may register the key 
segments by using part of the message itself with *^S. This feature wdl be useful 
for example, for saving the actual names of the message sender, in order to spot 
them later. 

User registration process is described in Fig. 1. The user inputs the key segment 
to be registered as either text, pronunciation (text), or speech form. The text is 
i processed through the text-to-speech front end to obtain the pronunciation. 

Speech is processed through the speech recognizer and a pronunciation :s 

I 
I 
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obtained. This promniciation is stored as the Key segment characteristics. 

When the voice messages are received, these are processed through the message 
handler shown in Fig. 2. to look for the registered and the predefined key 
segments The segment characteristics and speaker independent models (for the 
sound units of the pronunciation) are used during the message handling, to spot 
the key segment using wordspotting or phrase detection technology. In additK^n, 
utterance verification may be used to enhance the detection accuracy. The 
messages are then tagged with the key segments and their locations m the 
messages to facilitate their retrieval later. 

The message retrieval pbaae is shown in Fig. 3- On recdving the user enquiry for 
a segment, first it is checked to see if it is a registered or predefined segment. If 
go the message is already tagged asxd the desired segment is retrieved. If it is a 
new key segment, its pronunciation is first obtained as shown m Fig. 1 of user 
registration, and then the message is tagged using the message handler. After the 
messa^ is tagged, the desired segment is retrieved. 

When a key segment is retrieved, it can be saved for future use as a key segment 
by the use of the keys **S. This will enable us to save for example, the message 
■ sender's name in thdr own voice for later use of identifying, tagging and 
retrieving thdr messages. Furthermore, if the name segment is retrieved, it can 
be used to identify the caller and hence for message filtering and classification of 
messages according to the caller. 

This appUcation uses speech recognition, wordspotting, keyword detection and 
utterance verification technologies for spotting the key segments m the messages. 
It will also use speech coding technology for key segment spotting in coded voice 
mail messages. It requires utterance verification of variable number digits for 
retrieving, telephone numbers. 



PAGE 22/42*RCVD AT 1218/2003 2:41:43 PM {Eastern Standard T!ine]*SVR:USPTO€FXRF-1irDNIS:872930a ' CSID:972480 8865* DURATION (mm'$s);08-30 



12/08/2003 13:41 HITT GAINES, PC 1703S729306- 



NO. 490 P023 





to 


to 


o 




■H 


i 


St 




•H 




d <o 




u 
u 


1 Se 


Cha 



o 

•H 

(d 

i 

u 

04 








0 








44 




3 













o 

-H 

■P 
0} 
M 

+i 

CO 
-H 
01 

& 

d 

I 

CO 

s? 



-H 



D 



PAGE 23/42 * RCVD AT 12/8/2003 2:41 :43 PM [Eastern Standard Time] * SVR:USPT0?XRF-1I1 * DNIS:8729306 ' CSID:972 480 8865 * DURATION (mii)-ss):08-30 



12/^/2003 13:41 HIT! GAINES, PC 17038729306' 



NO. 490 Q024 




U 

o d 

O 
•rl 

-H O 
H -H 

rt -H 

» d 
di H 
cm d 



C4 CO 



PAGE 24/42 ' RCVD AT 1218/2003 2:41:43 PM [Eastern Standard Time] ' SVR:USPT0€FXRF-1/1 * DNIS:8729306 ' CSID:972 480 8865 ' DURATION (mm-s$):08-30 



12/^/2003 



13:41 



HITT GAINES, PC ^ 17038729306' 



NO, 490 [?025 




Q 




H 9 




S S ^ 


o 
>* 


Is 












cm 





I 

M 

PAGE 25/42 ' RCVD AT 121(12003 2:41 :43 PM [Eastern Standard Time] ' SVR:USPT0-EFXRF-1f1 * DNIS:8729308 ' CSID:972 480 886S ' DURATION (min-$s):08-30 



12/08/2003 



13:41 



HITT GftlHES, PC -> 1703^729306 



NO, 490 P026 





(jJ^ I^pM^ „ ^ 




PAGE 26Hr lO) AT 12ira(l3 2:«t:43 PM paslem StaniM Tiniel * SVR:liSI>T(){Fl(RF-^^^ 



12/08/2003 13:41 HIT! GAINES, PC ^ 1703872g30& 



NO. 490 CI027 



106 



-Jim. 




\/d err' A^m) £u,d 



0 pr^i'/OA. 




^orM.Y"^. — TT^^rr 

— ■ ■■ />uo^^^f^yphf^e£^ 

' J / It ^ < 



^i^^mp. ^ ^^"T^L^z-y /AU^ko^ if ^^tJSL 



PAGE 27/42 ' RCVD AT 12/812003 2:41 :43 PM [Eastern Standard Time] * SVR:USPT0-EFXRF-1/1 ' DNIS:8729306 ' CSID:972 480 8865 ' DURATION (min-ss):08-30 



m • 



12/08/2003 13:41 HITT GftlNES, PC ^ 17038729306 NO. 490 0028 




; PAGE im * RCVD AT 121812003 2:41:43 PM (Eastern Standard Time] ' SVR:USPT0€FXRF-1/1 ' DNIS:g729306 ' CSID:972 480 8865 * DURATION (min-ss):08-30 



12/^/2003 13:41 HITT GfilNES, PC ^ 1703872930& NO. 490 D029 

5. PRESEhfTSTAT 'O.E-^HEAgr ^'^ " 

Biid3y describe the do. >caireatfy-kiu>wnteeim0logytfaat(«iawtDtiietnve^^ Tfaiswotild 

ineitxde, for eacample, alreaify exisdiig product^ 

pei^tudly orthzougfadescxiptioiismpubUcaaom ^ 

y jpr.y^. .i-J — . ^-N^L./U >.A**-ri^ .j±^ri. ..'-.•fA. • rfi^^t' ?4 < 



ADVANCEMF ^JT HASTATE OF THE Airr t>^c^ feL Jr^ ' 



Briefly describe the umtpieadvaaeemeDtadiieved by tfaebv^^ Husmaybedone, for example, by 
describing a problem widi the prior ait that is solved (V iqieciSc oisjects ^ 



T HOW Achieved v«*^«^jcr»^ ^ W d.*ju^ /iuJCctr . ' 

Briefiy describe the inventioii and how it achieves the advaacemem described to paiagraph 6. 

^^teji. %./{^ "^1*^,- ^ ^'A — ^yaitf* o.^^'^n im'itft '^v^^^^'iiMrig^ ?ta^<o:g*^ 



PtSCmsURE OUTSIDE OF LUCE^^' n^^f^!^ """^J^ ^'^TS'^ «^ 



8. piscaSVMQVrSIPEOFLVCEhT 

Anticipated Publicaiioa Date: Publtodc^S^ T^W^^s^ ^ 1?,^ ^ 

Submitted to Publication Cleannpe? QYes 'VUNo 

If the invention was or will odkemose be diadosed to any Qon4.4iceitt employee, describe to i^om 
(perscHi/coBqnnyX when, wfaoe; why* and whether it wasAgviil be under a non-disdosure a g reement 





Sigpatute 


Date 


INVENTOR JItt: 








Signature 


Date 


INVENTORY: 








Signature 


Date 
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NO. 490 0030 



5. PttFSFNTSTATT £^^5 

Briefly describe tbe ctos.i«iit already-known technology that relates to tbe mvauioo. This would 
ineitide; for exami}Ie> already existiiig products, metfaods or eompositums which are known to you 
personally ofrdtfou^ descriptions in pubUcati(»is or patents. 



6 ADVANCEMET^tNSTATEOF-mEART 

Briefly describe the tffliqueadvateement achieved by the Tl>ismaybedone.fbrexafi^le»by 
describing a problem with Ae prior an that is solved or specific objects that are achieved by the ittv«ntioi 

7. HOW ACHIEVED 

BrieQy describe tbe invention and how it achieves the advaneenent described in paragraph 6. 

iXIi- W^^ ^»^....Jt- k^Ta^ fet^;.>.^u>- r-^*- j^i^^ •♦Si rrtfTftfi*^^ 

ft nrsrLQStmgQm-sroEOFLUQSNT o-^ ci^^ 

AnticiiMted Publication Date : PubUcaticmMame: 

Sdimitted to Publication Ceazance? Q Yes ISO No 

If the invention was or will otherwise be disclosed to any noii4.uceiit employee, describe to whom 
(petson/compaz^X when. ■Tibae, why, and whether it waa/wiU be under a oonsiisciosure agreement. 



9. INVENTOR #1: 





Signature 


Date 


INVENTOR #2: 








Signature 


Date 


INVENTORY: 








Signature 


Dale 



2/2 



PAGE 30/42 * RCVD AT 121812003 2:41 :43 PM (Eastern Standard Time] * SVR:USPT0-EFXRF-1I1 * DNIS:8729306 * CSID:972 480 8865 * DURATION (mm-ss):08-30 



12/08/2003 13:41 



HITT GAINES, PC ^ 1703B72930& 

EXHIBIT B 



June 16, a$98 



Lucent Technologies 

B«ll Labs Innervations 



NO, 490 EP031 




VIA EXPRESS MAIL 

Chris Kolefas, Esq. 
Baker & McKenzie 
805 Third Avenue 
Nfiw York, NY X0022 



Ccrparau Qdunsct 
iHtiilcciual Frcvtrty - law 



!01 C?awIord« <!l«rncr Road 
R<n>m 3K'206 
F-O. Box 5030 

Telephone 732 949 3147 
Pscsimik 732 949 0292 
E Mall hoiawa»ew 



Re: 



IDS Ko^ s 115465 

Kenneth M- Brovm 

Secretary 
Anna Brazil 



Telephone Mq> 

908-582-5998 



Fax Koy 
908-582-4020 



Telephone l^o. 

908-582-6925 



Dear Chris: 

t=„.S:SiL'pl«S Sirthi'^",i4 «"/„.y icen^ifiea .bov. f.. .i. thoughts 

and instructions- 

Managing Attorney ^^^^^ you MSsr.otliy the Managing Attorney and me, 

reason you cannot meet this ^^.an 2 weeks prior to our 

VIA FACSIMILE, as soon ^^P'^^^^^^-^^j"* attorney will then determine if a 
requested date. If .^^^d £n2vir thrManag^ Attorney and you 

rg^ertonraU'theTatrtr^i^rconf^^^^ via facsimile .ust he sent to 
the Managing Attorney and to me for our records. 

^ soon as you have identified the ^^f^^^^^^tl^^AV^J^^^^^ 
(732) 949-6068 for a case name ^"f,^"*^^^-*"^^cuted, please send a copy to 
but before the I>-=l*"^i°'^^ff .t^^Hnd orat authorizUion to file. The 
the Managing Attorney for ho. s '^^^^^^/"^ °";„^"^f fi^e directly to the VSPTO. 
completed application is to be '^^^^J/^^^ SsSo "ould be sent to Joyce 

^efr^uL^llf forrr%lfef t:^:^^^^^^^^^ -^^"^^^ ^"^"^ 

application . 

. r>.i*? letter to the Managing Attorney and to 



Very truly yours, 

Eli Weiss 
Corporate Counsel 



Received. 



EW: jp 

Atts. 
AS above 



Date: 



copy to; 
K, M. Brown 
C-H. Lee 
P . Ramesh 



PAGE 31/42 * RCVD AT 12/812003 2:41 :43 PM [Eastern Standard Time] « SVR:USPT0-EFXRF-1/1 « DNIS:8729306 « CSID:972 480 8865 * DURATION (min^s):08-30 



12/08/2003 13:41 HITT GAINES, PC 1703872930& NO. 490 



[?032 



SUBMISSION NO, : 115485 

ATTORNEY : Brown, Kenneth M. 

Title : 

Key Segment Spotting 
In Voice Messages 



-MAIN INFORMATION- 



ITEM STATUS 
STATUS DATE 
OPEN DATE 
CLOSE DATE 
DEADLINE DATE 
BU CODE(S) 



Opened 

05/28/1S98 

03/03/1998 



LUCEOT RATING 
PATENT WPN 
OOVT. CONTRACT 
TYPE 

DEFENSIVE 



UO 
No 

Patentability 

NO 



BLRS 

-SUBJUTTER INFORMATION- 



SUBMITTER NAME 

COMPANY 

tOC„EXT 

DEPARTMENT 

DIRECTOR 



Lee , Chin-Hui 
LUCENT 
MH 5226 
BL0113330 
S- Ahuja 



SUBMITTER NAME 

COMPANY 

LOC_EXT 

DEPARTMENT 

DIRECTOR 



Ramesli/ Padina 
LUCENT 
908-582-7688 
BL0113330 
S- Ahuja 



Brief Description : 



NO data in this field 
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NO. 490 I?033 



liAST NAME 
Lee 

THIRD NAME 



INVEm-OR INFORMATION 
FIRST NAHE 
SUFFIX 



MIDDLE NAME 
SSN 

046666589 



STREET 
CITY 

MAIL CITV 
COUNTY 
STATE 
CTRY CODE 
ZIP 

LOC/EXT 
COMPANY CODE 
DIRECTOR 
PATENT COUNT 
PREVIOUS NAME 



118 Runnymede Parkway 
New Providence 
New Providence 
Union 
NJ 
USA 
07974 
MH 5226 
LUCENT 
S. Ahuja 



P.O. BOX : 

RURAL ROUTE : 

CITIZENSHIP : 
ASSIGNEE CODE: 

FIRST PATENT : 

DEPARTMENT : 
LAST CASE 

REVISED DATE : 



USA 
LUCENT 

BL0113330 
21 

05/27/1998 



PAGE 33/42 * RCVD AT 1218/2003 2:41:43 PM [Eastern Standard Time] * SVR:USPT0€FXRF-111 * DNIS:8729306 * CSiD:972480 8865 * DURATION (mm'SS):08-30 



12/08/2003 



13:41 



HITT GAINES, PC -> 1703872930& 
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Ramesh , Padxna ( Padma ) 
hrid:y3730227 
tel=+l 903 58?. 7688 
fax=+l 908 582 7308 
cel= 

room-2C-568 
hpurl= 

600-700 Mountain Ave,P 



bg=BL 
bsg=B]JRS 
bu=BLRS 

Xoc=NJ9620 



org=BL0113330 

j tname=:rfteiTiber cechnicai staff 

jftail^to: praioesb01vcent . com 
ema^adma® research, bell -labs . < 
oldloc^itih 



O Box 636, Murray Hill, NJ 07974-0636 U S 
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NO. 490 P035 



Lee , Chin- Hu i ( Ch in - Hui > 
hrid=2165923 

tel=+l 908 582 5226 bg=BL 

fax=-»-l 908 582 7308 bsg=BLRS 

eel- tyu=BLRS 

pgr^ PPin= 

rooin-2D- 527 loc=NJ9 6 2 0 

600-700 Mountain Ave,P O Box 636. Murray Hill, KJ 07974-0636 U 



org=BL0113330 
jtname=m t s dept head 
id=chl 

;nail_to; chl ©lucent . Gom 
ema=chl@research- bell-labs. com 
oldloc-mh 
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EXHIBIT C 



NO. 490 D036 



Asia 



AMSTERDAM VBLJM 

DAHeCLOKA MOSCOW 

SCRUM HyWCM 

aUCAPCST PRAGUE 

CAlfta m^TAOM 

rnA**<PonT romC 
GENtVA rCTfiftMWRC 

KCV 8TOCKXai.« 

LAUflAHW; WARSAW 

LOfSDOH iLWCM 
MAOAlb 



BY FAX 



alMaTY 

BAKU 
BAMCKDA 



NO crtl WNM cn-Y 
HONG KOKtO 

HAnn.A 

ftwaAPORE 

TOKYO 



Baker & Mckenzie 

ATTORNEYS AT LAW 

BOS THIRD AVENUE 
NEW YORK, NEW YORK I0022 
TELEPHONE <212) 75I-57O0 
CABLE ABOGADO • TELEX e257^ 
FACSIMILE 121 2> 75»-9l33 



October 15, 1998 



South AME/iKA 



BO«OTA 
SRA«tUA 
bUCMOS AIR£& 
CARACAS 

OAlXAft 

MOUOTOW 

JUARCZ 



MTxteo err If 

MtAW 

M£W VOrtK 
PA1.0 AUTO 
P50 &t JANEIRO 
SAH &IC«0 



!»A« FRAhlCtSCO 

SANTIAW 

SAO PAUkO 

TIJUAHA 

TQRDNtO 

VAUKMCIA 

WASKtNCTON. Q.C. 



PadxnaRamesh 

Lucent Technologies Inc. 

Room 2C-568 

700 Mountain Avenue 

Murray Hill, NJ 07974-0636 

Re: Patent Application for 

KEY SEGMENT SPOTTING IN VOICE MESSAGES 

Case: LeeJ22J 

Dear Padma: 

Attached please find a first draft of the above-identified patent application. 

Please review the appUcation for accuracy and completeness. The application ruust 
provide sufficient information to allow a person of ordinary skill iti the field to implement and 
practice the invention. The application must also disclose the best mode of pracUcing the 
invention known to you. 

Please provide a copy of the application to Chin-Hui Lee for his review. 

As you will note, there are several questions in boldface in the draft application which 
you need to answer. Please provide your answers and/or comments as soon as possible so that 
we may file this application by Tuesday, October 20. 

If you have any questions, please do not hesitate to call xne at 212-891-3956. 

^ly. 



Att, 




Chris Kolefas 



INVUT] 497W 
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EXHIBIT D 

BAKER & Mckenzie 

Anomeys at Law 
805 Third Avenue 
NEW YORK, NEW YORK 10022 
Telephone: (212)751-5700 
Facsimile: (212)759-9133 

FACSIMILE TRANSMISSION 

PATE: Novembers, 1998 TIME: 

TO: Padma Ramesh 

COMPANY: Lucent Technologies, Inc. 
FAX 

mJMBER(8): 1-908-582-7308 
FROM: Chris Kolefa$ 

rEj Lee 22-1 (KEY SEGMENT SPOTTING IN VOICE MESSAGES) 
TOTAL NUMBER OF PAGES gNCLUPING THIS COVER PAGE): /3 . 



PPTVArV AND CONFroENTIALlTY NOTICE 



MESSAGE 



Padma: 



Attached is a second draft of the above-referenced patent application mcoiporating your wmments of 
10/20 into the first draft of the application (which I fax'ed to yoi, 10/15). As you can see there are several 
iSfsUonfthat iestill unanswered. Please review this draft. Perhaps ihis time it would be more eff.c.ent 
if we went over the application on the telephone, Please call me when you are ready to do so. 



Thank you, 
Chris Kolefas 



IF YOU HAD ANY TROUBLE RECEIVING THIS TRANSMISSION, 
PLEASE CALL (212) 75 1 -5700 EXT: J25$ IMMEDIATELY. 
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EXfflBIT E 
BAKER & Mckenzie 

Attorneys at Law 
805 Third Avenne 
NEW YORK, NEW YORK 10022 
Telephone: (212) 751-5700 
Facsimile: (212)759-9133 

FACSIMILE TRANSMISSION 



DATE: 
TO: 



Febmary 10, 1999 
Padma Ramesb 



TIME: 



COMPANY: 
FAX 

NUMBER(s): 
FROM: 

RE: 



Lucent Technologies, Inc. 

1-908-582-7308 
Chris Kolefas 

Lee 22-1 (KEY SEGMENT SPOTTING IN VOICE MESSAGES) 



TOTAL NUMBER OF PAGES (INCHJPING TfflS COVER PAGE); 14 



PRIVACY AND CONFIDENTIALrTY NOTICE 



Th. infornBltiOO «,«=ilnBl in thi. r»CSl«Ue Is Intended for Ih. nan«l r«lpi»U. only It toottin pnv.l«ed »^«^^™^* ^"'^^ 
a™ .Hit sn intended r«ipient, you n»St not am, distribute Or tnk* any .cHoh in «««,« on it ITyou "° 

us iwmediately 1^ » collett tdtphone <aU to ait) 7S1.S7<» and theori^nat to th« sender by mail. We will rtlMjnjrse yon tor poel>e«- Tin''"' 



MESSAGE 



Padnna: 

Attached is a third draft of the above-referenced patent appUcation. Please review this draft and provide to 
me your comments at your earliest convenience. 

Thank you, 

Chris Kolefas 



IF YOU HAD ANY TROUBLE RECEIVING THIS TRANSMISSION. 
PLEASE CAIi (212) 751-5700 FXT; 3956 IMMEDIATELY. 



INYUTI VXO^X 
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EXHIBIT F 



BAKER & McKENZlE 
Attorneys at Law 

805 Third Avenue 
NEW YORK, NEW YORK 10022 

Telephone: (212)751-5700 
Facsimile: (212) 759-9133 



FACSIMILE TRANSMISSION 



DATE: 
TO; 

FAX NUMBER: 
FROM: 



May 12, 1999 
Kenneth Brown, Esq. 
Lucent Technologies, Inc, 
908-582-4020 
Chris Kolefis 



TIME ; 



RE: 



Lee 22-1 and Lee 23-2 



TOTAL NUMBER OF PAGES (INCLUDING THIS COVER PAGE) : 31 



PRIVACY AND CONFIDENTIALITY NOTICE 



The lDfOrm.tiD3 coot^Md b ibis fbciimlte to tl»»C«!«l f«r tbc n-mcd rt^tntS only. It mmy t60Utn pnvilaged »d «ttlid.nti.l 
t«lepb0l>C to (212) 751-f!7«> rttum th* O^ig^l » S«nder by UttiL W, will T««biiftt <»r pioffee. Tl»«k yon- 

MESSAGE 



Dear Ken: 

Attached for your review are final drafts for Lee 22- 1 and Lee 23-2. Please provide any comments you 
may have at your earUest convenience. If eveiyth ing is in order, please let me so tiiat 1 can forward 
Declarations and Assignments to the inventors. Once I receive the executed forms, I will file the 
applications. 

Sincerely, 

Chris 



IF YOU HAD ANY TROUBLE RECEIVING THIS TRANSMISSION, 
PLEASE CALL (212) 751-5700 EXT: IMMEDL^TELY. 



[NYC] 305686.1 
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rWY 2S -99 16:12 PR BPKeR & MCKENZIE 212 759 9133 TO lF-oll5S34itt919a P. 07 

EXfflBXT G 



Any. Docket Noj Lee 22-1 
|S6l >5334/n5ia51 



ASSIGNMENT ANtf AGREEMENT 



J""" "^"^H- ^"'"H"* of Basking Ridge In the Gounty of Somerset and 
SWe of New Jersey and Padma Ram«sb, of New Providence in the County of Union and State 
of New Jersey, hereby sett, assign and transfer to Lucent Tecbnalogjes Inc., a corporation of the 
State of Delaware, having an office at 600 Mountain Avenue, P.O. Box 636, Murray HiU, New 
Jersey 07974-0636. U.S.A., and its successors, assigns and legal representatives, the entire right 
UUe and mterest, for the United States of America, in and to certain invenUons related to KEY ' 
SEGMENT SPOTTING IN VOICE MESSAGES the specification of which is filed herewitb 
as a United States Patent Application, and all the rights and privileges in said application and 
under any and all Letters Paiem that may be granted in the United Stales for said inventions; and 
we also concurrently hereby sell, assign and transfer to Lucent Technologies Inc. the entire right, 
title and interest in and to said inventions for aU countries foreign to the United States, including 
all nghts of priority arising torn the application aforesaid, and all the rights and privileges under 
^y and all forms of protection, including Letters Patent, thai may be granted in said countries 
foreign to the United States for said inventions. 

Wc authorize Luctait Technologies tic. to make application for such protection in its own 
name and maintam such fMiotecUon in any and all countries foreign to the United States, ami to 
invoke and claim for any application for patent or o&er form of protection for said inv«>tions, 
without further authorization fiom us, any and all benefits, iittluding the right of priority 
provided by any and all treaties, conventions, or agreements. 

We hereby consent that a copy of this assignment shaU be deemed a foil legal and formal 
equivalent of any document which may be required in any country in proof of the right of Lucent 
Technologies Inc. to apply for patent or other form of protection for said inventions and to claim 
thft aforesaid benefit of the right of priority. 

We request that any and all patents for said inventions be issued to Lucent Technologies 
Inc. m the United States and in all countries foreign to the United States, or to such nominees as 
Lucent Technologies Inc. may designate. 



INYO] J4993?.» 
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We agree that, when requested, we shall, without charge to Lutcnt Technologies Inc. but 
at its expense, sign all papers, and do all acts vs*ich onay be necessary, desirable or convenient in 
connection with said plications, patents, or other fonns of protection. 



United States of America ) 

State of ''%u//^ ^tA4U^ ) as.: 

Couniyof (jLr-^^^rr^ ) 

On this 7^' day of 19?^ . before mc personally came 

Chin Hm Lee, to me known to be the ixj^vidual described in and who executed the foregoing 
instrument, and acknoi;^edged execution of thi? same. 




tMwy Nbfe cf Mm Jkviy 
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Pfldxna Ramcsh 

Date:. 

United States of America ) 
Stateof "Tjw^- ^^/^^^^)^\ 
Couniy of i^.^^K-'Ctr^wy ) 

On this day of Qt^^^ 1 9 9^ ^ before me personally came 



P&dma Ramesh, to me known to be the ipmvidual described in and who executed the foregoing 
instnmient, and acknowledged execution of the same. 
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HiTT Gaines, P.C. 

Intellectual Property Law & Related Matters 

FACSIMILE TRANSMISSION 



RECEIVED % 

CENTRAL RMCBIfER ^ 

utC 0 8 2003 



OFf/CMI 



TO: Examiner Gerald Gauthier 

Group Art Unit 2645 

FAX NO. (703) 872-9306 

FROM: J. Joel Justiss 

RE: Serial Na 09/325,143 

Attorney Docket No. C. LEE 22-1 

DATE: December 8, 2003 

PAGES: (including cover page) 

If you do not receive the indicated noimber of pages, please notify the sender at the telephone 
number shown below. Thank you. 

THE INFORMAHON CONTAINED IN THIS FACSIMILE TRANSMISSION IS AITORN£Y-CU^^ 

COMMUNICATION INTENDED FOR THE EXCLUSIVE US£ OF THE INTENDED RECIPIENT NAMED ABOVE. IF YOU ARE NOT THE 

^^^,^U^'^I^Y NOT^ DISSEMINATION, DISTRIBUTION OR COPYlNC OF THIS TRANSMISSION 

STRICTLY PROHmrrED. YOU HAVE RECEIVED THIS TRANSMISSION IN ERROR. PLEASE NOTIFY TTO SENDERJM^ 
AT THE TELEPHONE NUMBER SHOWN BELOW AND MAIL THE ORKHNAL TRANSMISSION TO THE ADDRESS BELOW. WE WILL 
REIMBURSE YOU FOR AhTY REASONABLE EXPENSE YOU MAY INCUR DOING SO. THANK YOU. 



Mailing Address: P.O. Box &32570, Richardson, Texas 75083 
Street Address: 225 Univ»rsity Plaza, 275 West Campbell Road, Richardson, Texas 75080 U.S.A. 
Tel: (972) 48P-6800 Fax: (972) 480-8865 flrm@abstractassets.com 
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